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Abstract 

A procedure for generating non-differentiable, continuously difFer- 
entiable, and twice continuously differentiable classes of test functions 
for multiextremal multidimensional box-constrained global optimiza- 
tion and a corresponding package of C subroutines are presented. Each 
test class consists of 100 functions. Test functions are generated by 
defining a convex quadratic function systematically distorted by poly- 
nomials in order to introduce local minima. To determine a class, the 
user defines the following parameters: (i) problem dimension, (ii) num- 
ber of local minima, (iii) value of the global minimum, (iv) radius of 
the attraction region of the global minimizer, (v) distance from the 
global minimizer to the vertex of the quadratic function. Then, all 
other necessary parameters are generated randomly for all 100 func- 
tions of the class. Full information about each test function including 
locations and values of all local minima is supplied to the user. Partial 
derivatives are also generated where possible. 

Key Words: Global optimization, test problems generation, known local 
minima 
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1 Introduction 



A wide literature is dedicated to development of numerical algorithms for 
solving the global optimization problem (see, for example, references given 
in [7]). The problem may be formulated as 



where f{x) is a multiextremal and possibly non-difFerentiable function and 
is a compact set. 

One of the approaches to studying and verifying validity of numerical 
algorithms is their comparison on test problems (see, e.g., [T], [2], [3], [3], 



m, M, m, m, m, m, m, m, m, m, m-, m, m, m-, m, m 




[23j). Many global optimization tests were taken from real-life problems and 
for this reason comprehensive information about them is not available. The 
number of local minima may be unknown, as well as their locations, regions 
of attraction, and even values (including that of the global minimum). 

Recently [6] introduced two types of functions with a priori known local 
minima and their regions of attraction. The tests proposed take a convex 
quadratic function (called hereafter 'paraboloid') systematically distorted by 
cubic polynomials and by quintic polynomials to introduce local minima and 
to construct test functions that are continuously differentiable in some region 
Q, D T (called hereafter 'D-type' test functions) and twice continuously 
differentiable in ^ J-" (called hereafter 'D2-type' test functions), where T 
is from ([T]) and is a hyperrectangle. 

To define a function of one of these types it is necessary to determine 
a number of correlated parameters. Unfortunately, the correlations do not 
allow simple and fast generation of the test functions. Additionally, gener- 
ation of different functions having similar properties becomes difficult and 
non- intuitive when dimension and/or number of local minima increase. 



In this paper, in addition to the two types of test functions from [6j, the 
third type of non-differentiable test functions (called hereafter 'ND-type') 
is presented and a generator for these three types of test functions is pro- 
posed. The software to be introduced generates classes of test functions and 
provides procedures for calculating the first order derivatives of the D-type 
test functions and the first and second order derivatives of the D2-type test 
functions. 

Each class contains 100 functions and is defined by the following param- 
eters (the only ones to be determined by the user): 

1. problem dimension; 

2. number of local minima; 

3. value of the global minimum; 




N 
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4. radius of the attraction region of the global minimizer; 

5. distance from the global minimizer to the vertex of the paraboloid. 

The other necessary parameters (i.e., locations of all minimizers, their 
regions of attraction, and values of minima) are chosen randomly by the 
generator. After generation a special notebook containing a complete de- 
scription of all the functions from the generated class is supplied to the 
user. 

The rest of the paper is structured as follows. In Section [21 a mathemat- 
ical description of the three types of test functions is given. Section [3] intro- 
duces the generator and details of its implementation. Section H] is devoted 
to usage of the generator. 

2 Mathematical description 

In this section, the three types of test functions are briefly described. Let 
us start with the D-type and D2-type functions (see [6]). A function f{x) 
of the D-type is determined over an admissible region Q ^ J-, where J- is 
from ([1]) and 

n=[a,b]={xeR^ : a<x<b}, a<b, a,beR^. (2) 

The function is constructed by modifying a paraboloid Z: 

Z : g{x) = \\x -Tf + t, x e Q, (3) 

(hereafter || • || denotes the Euclidean norm) with the minimum t at a point 
T G int(r2) in such a way that the resulting function f{x) has m, m > 2, 
local minimizers: point T from ^ (we denote it by Mi := T) and points 

Mi G int(O), Mi^T, Mi^ Mj, i, j = 2, . . . ,m, i ^ j. (4) 

The paraboloid Z from Q is modified by a function Ci{x), which is con- 
structed by using cubic polynomials within balls 5j C O around each point 
Mi, i = 2, . . . ,m, where 

Si = {x e : \\x - Mi\\ <pi,pi>0}, i = l,...,m. (5) 

Functions Qi{x), i = 2, ...,m, use quintic polynomials to determine the 
D2-type test functions. 

Selection of radii pi, i = 1, . . . ,m, is carried out in such a manner that 
sets Si from ^ do not overlap: 

SinSj = 0, i,j = l,...,m, i^j. (6) 
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It is not required that each attraction region Si, i = 1, . . . ,m, be entirely 
contained in f2. Note that we use the notation "attraction region" with 
respect to the bahs Si, i = 1, . . . ,m, just for simphcity. Naturally, definition 
of the real attraction region for each local minimizer will depend on the 
method used for optimization and will change from one algorithm to another. 
Formally, D-type functions [6j are described as follows: 

f(\_j Ci{x), X E Si, i € {2, . . . , m}, 

where g{x) is from ([3]), sets Si, i = 2, . . . ,m, from ([5]) satisfy ([6]), and 

f 2 <x- Mi,T - Mi> 2 \„ ,^„o 

= — II ,^|| ^Ai] \\x-Mif+ 

\Pi \\x-Mi\\ pf J 



+ ( 1 - - """r'.^^"^" +^A]\\x-M.\n U (8) 



4: <x - Mi,T - Mi> 3 
Pi \\x-Mi\\ pf 

In ([8]) radii pi, i = 2, . . . ,m, determine the sets Si from ([5]), < •, • > denotes 
the usual scalar product, and the values Ai, i = 2, . . . ,m, are found as 

A = \\T-M,f + t-fi, (9) 

where fi = t and fi, i = 2, . . . ,m, are the function values at local minimizers 
Mi-. 

fi = mm{g{x) : x e Bi} - ji, ji > 0, (10) 

where Bi is the boundary of the ball Si: 

Bi = {xeR^ : \\x-Mi\\ =pi, pi>0}, i = 2,...,m, (11) 

and 7j is a parameter ensuring that the value fi is less than the minimum 
of the paraboloid Z from ([3]) over Bi. 

Analogously, D2-type functions |6] are defined by 

f(^\-jQiix)^ xeSi,ie{2,...,m}, 

' \ 9{x), X(^S2U...USm, ^ ' 

where 



Qi{x) 



6 <x-Mi,T-Mi> 



PI 



\x - Mi 



+ -^^ + 73(1-2 



Pi 



Pi 



'16 <x- Mi, T-Mi> 15 _3_ 6_. 

A 7i~7r~~^\ 

12 <x - Mi, T- Mi> 10 . 3_ _ ^ 

p1 ' P^^ 2^. 

]^5\\x-Mif + fi 



\x - Mi\ 



x-Mif+ 

x-Mit+ 
\\x-Mif+ 



(13) 
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with Ai and fi, i = 2, . . . ,m, from ([9]) and (jlOp . and (5 is an arbitrary positive 
real number (see [6l Lemma 3.1]). 

The properties of these functions have been studied by [6j. In particular, 
the following results can be proved: 

i. D-type functions ([Z1)-(IH]) are continuously differentiable in Q [6, Lemma 
2.1]. 

ii. D2-type functions (|12|) -(|13 p are twice continuously differentiable in (7 
[6l Lemma 3.1]. 

Let us now describe the ND-type test functions, which are continuous 
in ri but non-differentiable in the whole region Q. An analogous procedure 
is considered: the paraboloid Z from ([3]) is modified by a function Pi{x) 
constructed from second degree polynomials within each region Si C 
from ([5]) in such a way that the resulting function f{x) is continuous in 
the feasible region $7 from ([2]), differentiable at each local minimizer Mj, 
i = 2, . . . ,m, from but generally non-differentiable at the points of the 
boundaries Bj of the balls Si, i = 2, . . . ,m, determined by (fTTj) . That is. 



fr-r^ = / x^Si,ie{2,...,m}, , . 

■^^^^ \g{x), X^S2U...USm, ^ ' 

where g{x) is from ([3]), sets Si, i = 2, . . . ,m, from 1^ satisfy i^, and 

P, W = (l _ I5£^i^ ^ + 4^.) II, _ M,|P + /.. (15) 

V Pi \\x - Mi\\ pf J 

In (jlSp the values pi, Ai, and fi {i = 2, . . . , m) are determined in the same 
way as for the D- and D2-type functions by formulae ([n])-®, ([9]), and p^ . 
respectively. 



3 Generation of tests classes 

As one can see from the previous section, all three function types have many 
parameters to be coordinated. Moreover, their characteristics (for example, 
the mutual positions of the local minimizers, the global minimizer, and the 
paraboloid vertex; the size of the attraction regions of local minimizers; the 
function values at local minima) influence the properties of the test func- 
tions significantly from the point of view of global optimization algorithms. 
For example, coincidence of the global minimizer with the paraboloid ver- 
tex leads to generation of too simple functions. Existence of many deep 
minima having narrow regions of attraction can lead to the impossibility of 
global minimizer location even by the most "intelligent" global optimization 
algorithms. All these features should be added to the general scheme from 
Section [5] in order to obtain well-structured test classes. 

In the generator, the user sets just a few parameters defining a desirable 
class while all the other parameters are chosen randomly. The generator 
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is also employed in maintaining conditions distinguishing each class - for 
example, the distance of the global minimizer from the minimizer of the 
paraboloid, dependence of the local minima values on the attraction regions 
sizes, etc. Thus, the generator gives the researcher the ability to construct 
classes of 100 test functions of arbitrary dimension with arbitrary number 
of local minima. 

This section describes how a class consisting of D-type test functions is 
generated. Classes consisting of D2-type and ND-type functions are con- 
structed analogously. 

Each test class generated by the introduced software contains 100 test 
functions /(x) and is defined by the following parameters to be fixed by the 
user: 

1. the problem dimension N, N >2; 

2. the number of local minimizers m, m > 2, including the minimizer T 
for the paraboloid ([3]) (all the minimizers are chosen randomly); 

3. the global minimum value /*, the same for all the functions of the 



4. the radius p* of the attraction region of the global minimizer x*; 

5. the distance r* from the paraboloid vertex T to the global minimizer 
X* € O (whose coordinates are also chosen randomly). 

By changing these parameters the user can create classes with different prop- 
erties. 

Each function of a test class is specified by its number n, 1 < n < 100. 
The other parameters of the functions from ([5|)- (|15|) are chosen randomly 
by means of the random number generator proposed in |10j . 

The input parameters /*, r*, and p* must be chosen in such a way that 
the following simple conditions are satisfied: 



(which means that the global minimizer is not a vertex of the paraboloid; this 
requirement allows us to avoid too simple functions with a global minimum 
at the vertex of the paraboloid Z from 



(i.e., the global minimizer x* belongs to the admissible region $7 even in the 
case when the paraboloid vertex T is at the center of fi), and 



class; 



(16) 




iiXJ^(j) - a{j)\ 



(17) 



0< p* < 0.5r*. 



(18) 
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Note that it is not required that each attraction region Si, i = 1, . . . , m, 
from ([5]) entirely belongs to Vt. 

The admissible region O is taken as O = [—1, 1]^ and the minimal value 
of the paraboloid ([3]) is fixed at t = by default (naturally, these parameters 
can be changed by the user). 

Let us discuss in more detail the random procedure generating param- 
eters for test functions. (The unique difference for the D2-type is that the 
parameter 5 from (|13p is required; this parameter is chosen randomly from 
the open interval (0,A), where A is a positive number taken by default 
A = 10.) Hereafter the vertex T from ([3]) in the set Q of local minimiz- 
ers has the index 1, Mi := T, and the global minimizer x* has the index 
2, M2 ■= X* . Naturally, among the minimizers Mj, i = 3, . . . ,m, another 
global minimizer y* ^ x* can be generated. 

First, coordinates of the paraboloid vertex T, coordinates of the global 
minimizer x* , and coordinates of the remaining local minimizers Mj (con- 
trolling the satisfaction of dH) are chosen randomly. Then, the attraction 
regions radii pi, i 7^ 2, from ([5]) are determined: to do this the attrac- 
tion regions of each local minimizer from dH (« 7^ 2 because the attraction 
region of the global minimizer is fixed: p2 = p*) are expanded until condi- 
tion ([HD is not violated. Finally, values of the function f{x) at local minima 
Mi, i = 3, . . . ,m, are fixed by choosing random values 7^, i = 3, . . . ,m, 
from ([TO]) (recah that /i = t and /2 = /*). 

Let us consider these three principal operations in detail. 

Coordinates of the local minimizers Mi, i = 3,...,m, from coor- 
dinates of the vertex T of the paraboloid ([3]), and location of the global 
minimizer x* are chosen randomly at the intersection of and the sphere 
of radius r* with a center at T so that Q is satisfied. For the positioning 
of X* we use generalized spherical coordinates 

i-i 

X* := Tj + r* cos (^ij sin , j = l,...,N - 1, 

k=l 

N-l 

x*^:=TN+r*Y[sm4>k, (19) 
k=l 

where the components of the vector 

</. = (,/.i,...,</.^) G$ = {O<0i <^; 0<,/.j <27r, j = 2,...,N} 

are chosen randomly. In this case, if some x^. ^ 1 < k < N, this 
coordinate is redefined as 

xl := 2Tk — xl- 
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After selection of coordinates of the paraboloid vertex T and of the global 
minimizer x*, coordinates of the points Mi, i = 3, ... ,171, are generated in 
such a way that beside condition dH) the condition 

\\Mi-x*\\- p* = C, C>0 (20) 

is satisfied with some positive parameter This condition follows from ([6]) 
and does not allow the local minimizers to be very close to the attraction 
region of the global minimizer x*. Thus, in ()20p the parameter should not 
be too small. The value ( = p* is chosen by default. 

The next step of the test function construction sets attraction regions. 
Each value pi, i ^ 2, from ^ is initially calculated as half of the minimum 
distance between the minimizer Mj and the remaining local minimizers 

Pi := 0.5 min ||Mj— Mj||, i = l,...,m, i 7^ 2, 

P2 := P* (21) 

(in such a way that the attraction regions from ([5]) do not overlap). Then, 
an attempt to increase the values pj, z = 1, . . . , m, i 7^ 2 (i.e., an attempt to 
enlarge the attraction regions) is made: 

Pi := max! Pi, min {||Mj - M,- 1| - p^} ) , i = 1, . . . , m, i / 2. (22) 

\ i<i<ni, jV* / 

Because of the recursive character of formulae (|22p . an expansion of the 
attraction regions depends on the order in which these regions are selected 
(an ascending order of the indices is chosen). 

Finally, the values of the radii pi are corrected by the weight coefficients 

Wi'. 

Pi:=WiPi, i = l,...,m, 
where < Wi < 1, i = 1, . . . ,m, and the values Wi are chosen by default as 

Wi = 0.99, i = 1, . . . , m, i ^ 2, and W2 = 1. (23) 

At the last step the function values /j, i = 3, . . . , m, at the local minima 
are generated by using formula (jlOp . where 7^ must be specified. Each value 
7j, i = 3, . . . , m, is chosen (note that the values 71 and 72 are not considered 
because the function values /i = t at the paraboloid vertex and /2 = /* at 
the global minimizer have been fixed by the user without using (jlOp ) as the 
minimum of two values generated randomly from the open intervals (pj, 2pj) 
and (0, — /*), where Zb^ is the minimum of the paraboloid Z from ^ 
over Bi from ()lip . In such a way, the values fi in (jlOp depend on radii pi of 
the attraction regions Si, i = 3, . . . ,m, and at the same time the following 
condition is satisfied: 

f* < fi, i = 3,...,m. 
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Figure 1: The function number 9 from a class of two-dimensional D-type 
test functions with 10 local minima 

Note that dependence of the function values at local minima on the radii of 
the attraction regions is not respected by the global optimum value /2 = /* 
because the user defines the function value at the global minimizer and the 
radius p* of its region of attraction directly when choosing the corresponding 
test class. 

Figure [T] shows an example of the D-type test function. This function 
is defined in the region Q. = [—1, 1]^ and is number 9 in the class of D-type 
functions with the following parameters: 

1. dimension N = 2; 

2. number of local minima m = 10; 

3. value of the global minimum /* = —1; 

4. radius of the attraction region of the global minimizer /9* = |; 

5. distance from the global minimizer x* to the vertex T of the paraboloid 
from ([3]) is r* = |. 

The generated global minimizer of this function is x* = (—0.911,0.989) and 
the paraboloid minimizer is T = (—0.711,0.353). 
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4 Usage of the test classes generator 



The generator package has been written in ANSI Standard C and success- 
fully tested on Windows and UNIX platforms. Our implementation follows 
the procedure described in Section [3l First, the general structure of the 
package is described, then instructions for using the test classes generator 
(called hereafter GKLS-generator) are given. 

4.1 Structure of the package 

The package includes the following files: 
gkls.c ~ the main file; 

gkls.h - the header file that users should include in their application projects 
in order to call subroutines from the file gkls.c; 

rnd_gen.c - the file containing the uniform random number generator pro- 
posed in Knuth [[TO]; [TT]]: 

rnd_gen.h - the header file for linkage to the file rnd_gen.c; 

example. c - an example of the GKLS-generator usage; 

Makefile - an example of a UNIX makefile provided to UNIX users for 
a simple compilation and linkage of separate files of the application 
project. 

For implementation details the user can consult the C codes. Note that 
the random number generator in rnd_gen.c uses the logical-and operation 

for efficiency, so it is not strictly portable unless the computer uses 
two's complement representation for integer. It does not limit portability 
of the package because almost all modern computers are based on two's 
complement arithmetic. 

4.2 Calling sequence for generation and usage of the tests 
classes 

Here we describe how to generate and use classes of the ND-, D-, and D2- 
type test functions. Again, we concentrate on the D-type functions. The 
operations for the remaining two types are analogous. 

To utilize the GKLS-generator the user must perform the following steps: 

Step 1. Input of the parameters defining a specific test class. 

Step 2. Generating a specific test function of the defined test class. 

Step 3. Evaluation of the generated test function and, if necessary, its par- 
tial derivatives. 
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Step 4. Memory deallocating. 
Let us consider these steps in turn. 

4.2.1 Input of the parameters defining a specific test class 

This step is subdivided into: (a) defining the parameters of the test class, 
(b) defining the admissible region 0, and (c) checking (if necessary). 

- (a) Defining the parameters of the test class. The parameters to be 
defined by the user determine a specific class (of the ND-, D- or D2-type) 
of 100 test functions (a specific function is retrieved by its number). There 
are the following parameters: 

GKLS-dim - (unsigned int) dimension N (from ([T])) of test functions; 
N > 2 (since multidimensional problems are considered in ([1])) and 
N < NUM_RND in rnd_gen.h; this value is limited by the power of 
unsigned int-representation; default N = 2; 

GKLS-num_minima ~ (unsigned int) number m (from ^) of local min- 
ima including the paraboloid Z minimum (from ([3|)) and the global 
minimum; m > 2; the upper bound of this parameter is limited by the 
power of unsigned int-representation; default m = 10; 

GKLS-globaLvalue - (double) global minimum value /* of /(x); condi- 
tion (|16|) must be satisfied; the default value is —1.0 (defined in the 
file gkls.h as a constant GKLS_GLOBAL_MIN_VALUE); 

GKLS-globaLdist - (double) distance r* from the paraboloid vertex T in ([3]) 
to the global minimizer x* € of /(x); condition (jl7p must be satis- 
fied; the default value is 

GKLS_globaLdist =^ ^min Jb{j) - a{j)\/ 3, 

where the vectors a and b determine the admissible region 17 in ([2]); 

GKLS-globaLradius - (double) radius p* of the attraction region of the 
global minimizer x* G 17 of /(x); condition (|18p must be satisfied; the 
default value is 

GKLS_globaLradius '= rnin^ |6(j) — a(j)j/ 6. 

The user may call subroutine GKLS-set_default{) to set the default values 
of these five variables. 

-(b) Defining the admissible region 17. With N determined, the user 
must allocate dynamic arrays GKLS-domainJeft and GKLS-domain_right 



11 



to define the boundary of the hyperrectangle This is done by calUng 
subroutine 

int GKLS-domain_alloc (); 
which has no parameters and returns the following error codes defined 
in gkls.h: 

GKLS_OK - no errors; 

GKLS_DIM_ERROR - the problem dimension is out of range; it must 
be greater than or equal to 2 and less than NUM_RND defined in 
rnd_gen.h; 

GKLS_MEMORY_ERROR - there is not enough memory to allocate. 

The same subroutine defines the admissible region il. The default value 
n = [-1, 1]^ is set by GKLS.set.default{). 

— (c) Checking. The following subroutine allows the user to check validity 
of the input parameters: 

int GKLS-parameters-check (). 
It has no parameters and returns the following error codes (see gkls.h): 

GKLS_OK - no errors; 

GKLS_DIM_ERROR - problem dimension error; 

GKLS_NUM_MINIMA_ERROR - number of local minima error; 

GKLS_BOUNDARY_ERROR - the admissible region boundary vectors 
are ill-defined; 

GKLS_GLOBAL_MIN_VALUE_ERROR - the global minimum value 
is not less than the paraboloid Q minimum value t defined in gkls.h 
as a constant GKLS_PARABOLOID_MIN; 

GKLS_GLOBAL_DIST_ERROR - the parameter r* does not satisfy (fTTD : 

GKLS_GLOBAL_RADIUS_ERROR - the parameter p* does not sat- 
isfy (fT8]). 

4.2.2 Generating a specific test function of the defined test class 

After a specific test class has been chosen (i.e., the input parameters have 
been determined) the user can generate a specific function that belongs to 
the chosen class of 100 test functions. This is done by calling subroutine 

int GKLS-arg_generate (unsigned int nf); 
where 

nf - the number of a function from the test class (from 1 to 100). 
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This subroutine initializes the random number generator, checks the input 
parameters, allocates dynamic arrays, and generates a test function following 
the procedure of Section [3l It returns an error code that can be the same 
as for subroutines GKLS-parameters-check{) and GKLS-domain-alloc{), or 
additionally: 

GKLS_FUNC_NUMBER_ERROR - the number of a test function to 
generate exceeds 100 or it is less than 1. 

GKLS-arg_generate{) generates the list of all local minima and the list of 
the global minima as parts of the structures GKLS-minima and GKLS-glob, 
respectively. The first structure gathers the following information about all 
local minima (including the paraboloid minimum and the global one): coor- 
dinates of local minimizers, local minima values, and attraction regions radii. 
The second structure contains information about the number of global min- 
imizers and their indices in the set of local minimizers. It has the following 
fields: 

num^globaLminima - (unsigned int) total number of global minima; 

gni-index - (unsigned int *) list of indices of generated minimizers, which 
are the global ones (elements to {num.glohaLminima — 1) of the list) 
and the local ones (the remaining elements of the list). 

The elements of the list GKLS-glob.gm_index are indices to a specific min- 
imizer in the first structure GKLS-minima characterized by the following 
fields: 

locaLmin - (double **) list of local minimizers coordinates; 

/ - (double *) list of local minima values; 

rho - (double *) list of attraction regions radii; 

peak - (double *) list of parameters 7i values from (|10|) : 

W-rho - (double *) list of parameters Wi values from (j23p . 

The fields of these structures can be useful if one needs to study properties 
of a specific generated test function more deeply. 

4.2.3 Evaluation of a generated test function or its partial deriva- 
tives 

While there exists a structure GKLS-minima of local minima, the user can 
evaluate a test function (or partial derivatives of D- and D2-type func- 
tions) that is determined by its number (a parameter to the subroutine 
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GKLS-arg_generate{)) within the chosen test class. If the user wishes to eval- 
uate another function within the same class he should deallocate dynamic ar- 
rays (see the next subsection) and recall the generator GKLS-arg_generate{) 
(passing it the corresponding function number) without resetting the input 
class parameters (see subsection I4.2.ip . If the user wishes to change the test 
class properties he should reset also the input class parameters. 

Evaluation of an ND-type function is done by calling subroutine 

double GKLS.NDJunc (x). 
Evaluation of a D-type function is done by calling subroutine 

double GKLS.D_func (x). 
Evaluation of a D2-type function is done by calling subroutine 

double GKLS.D2Junc {x). 
All these subroutines have only one input parameter 

X - (double *) a point x G where the function must be evaluated. 

All the subroutines return a test function value corresponding to the point 
X. They return the value GKLS_MAX_VALUE (defined in gkls.h) in two 
cases: (a) vector x does not belong to the admissible region and (b) the 
user tries to call the subroutines without generating a test function. 

The following subroutines are provided for calculating the partial deriva- 
tives of the test functions (see Appendix). 

Evaluation of the first order partial derivative of the D-type test functions 
with respect to the variable Xj (see (|A.ip - ()A.2p in Appendix) is done by 
calling subroutine 

double GKLS-D_deriv [j, x). 
Evaluation of the first order partial derivative of the D2-type test functions 
with respect to the variable xj (see ()A.3|l - ()A.4p in Appendix) is done by 
calling subroutine 

double GKLS.D2.derivl {j, x). 
Evaluation of the second order partial derivative of the D2-type test func- 
tions with respect to the variables Xj and Xk (see in Appendix the formu- 
lae (|A.5p - (|A.6p for the case j ^ k and (|A.7p - (|A.8p for the case j = k) is 
done by calling subroutine 

double GKLS.D2.derw2 {j, k, x). 
Input parameters for these three subroutines are: 

j, k - (unsigned int) indices of the variables (that must be in the range 
from 1 to GKLS-dim) with respect to which the partial derivative is 
evaluated; 

X - (double *) a point x € M.^ where the derivative must be evaluated. 

All subroutines return the value of a specific partial derivative correspond- 
ing to the point x and to the given direction. They return the value 
GKLS_MAX_ VALUE (defined in gkls.h) in three cases: (a) index (j or 
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k) of a variable is out of the range [l,GKLS-dim]; (b) vector x does not 
belong to the admissible region Q; (c) the user tries to call the subroutines 
without generating a test function. 

Subroutines for calculating the gradients of the D- and D2-type test func- 
tions and for calculating the Hessian matrix of the D2-type test functions 
at a given feasible point are also provided. These are 

int GKLS-D_gradient (x, g), 

int GKLS-D2-gradient {x, g), 

int GKLS-D2-hessian (x, h). 
Here 

X - (double *) a point x G M.^ where the gradient or Hessian matrix must 
be evaluated; 

g - (double *) a pointer to the gradient vector calculated at x; 

h - (double **) a pointer to the Hessian matrix calculated at x. 

Note that before calling these subroutines the user must allocate dynamic 
memory for the gradient vector g or the Hessian matrix h and pass the 
pointers g oi h as parameters of the subroutines. 

These subroutines call the subroutines described above for calculating 
the partial derivatives and return an error code (GKLS_DERIV_EVAL_ERROR 
in the case of an error during evaluation of a particular component of the 
gradient or the Hessian matrix, or GKLS_OK if there are no errors). 

4.2.4 Memory deallocating 

When the user concludes his work with a test function he should deallo- 
cate dynamic arrays allocated by the generator. This is done by calling 
subroutine 

void GKLSJree (void); 
with no parameters. 

When the user abandons the test class he should deallocate dynamic 
boundaries vectors GKLS-domainJeft and GKLS-domairi-right by calling 
subroutine 

void GKLS-domairi-free (void); 
again with no parameters. 

It should be finally highlighted that if the user, after deallocating mem- 
ory, wishes to return to the same class, generation of the class with the same 
parameters produces the same 100 test functions. 

An example of the generation and use of some of the test classes can be 
found in the file example.c. 
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A APPENDIX 

Formulae of derivatives of the D- and D2-type test functions 

In this section, analytical expressions of the partial derivatives of the D- 
and D2-type test functions are given. We denote by T = (Ti, . . . ,T]y) the 
minimizer of the paraboloid Z from Q and by Mj = (m^^, mjy), i = 
2,...m, the local minima (from @) of a test function. Thus, for a D-type 
test function f{x) given by ©-([H]) we have (see [6]): 
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with hj{x) = {Tj - m'j)\\x - Mi\\- <x- Mi,T - Mi> (xj - m*)/||x - Mi||. 

The first order partial derivatives of the D2-type test functions f{x) 
given by P^ ~ P^ are calculated as follows (see 
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with hj{x) = {Tj - mi)\\x - Mi\\- <x-Mi,T-Mi> (xj - m})/||a; - M^lj. 

Let us now consider the second order derivatives d"^ f{x)/dxjdxk and 
d"^ f{x)/dx'j of the D2-type test functions f{x). For mixed partial derivatives 
d'^f{x)/dxjdxk we have 
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while for pure partial derivatives d'^f{x)/dx'j we have 
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